Windows does not understand ext3 or ext4 file systems so you can't format from Windows. However the installer can create the partitions it needs see Dual boot windows XP and Ubuntu 12.04 as suggested by Radu.
Ext3Fsd is an ext2/3/4 file system driver for Windows (2K/2003/XP/7/8/10). It's a free and open-source software, everyone can modify or distribute under GNU GPLv2.
This guide explains how to format partition to EXT4, EXT3 and EXT2 in Windows 10/8/7/XP as well as presents the process of creating Ext4 partition in Windows with DiskGenius Free.